REMARKS/ARGUMENTS 

Applicants note with appreciation the Examiner's acknowledgment of applicants' claim 
to priority based on a patent application filed in Finland on March 1, 1999, however, no certified 
copy of the Finnish application has been received as required by 35 U.S.C. §1 19(b). Applicants 
have ordered a certified copy of the Finnish patent application, and will submit the application to 
the Patent Office in due course. 

Furthermore, applicants have ordered a translation of the foreign application, and in 
accordance with 37 C.F.R. §1.55, applicants will submit the translation in due course. 

The specification has been amended to overcome the objections raised by the Examiner 
with respect to appropriate headings and appropriate spelling. 

Claims 1 through 16 have been amended and new claims 17-19 have been added to 
overcome the Examiner's objection with respect to proper headings and spelling. 

Claims 1 through 16 have been amended to place the claims in better form under U.S. 
practice. Further, claims 1 through 16 have been amended to more particularly define what 
applicants regard as the invention. New claims 17-19 have been added to more particularly 
define applicants' invention. These amendments make explicit what applicants believed was 
already implicit and, therefore, are not made for purposes related to patentability. 

Claims 2, 6, 7, 9, 10, 12, 14 and 16 stand rejected under 35 U.S.C. §112, second 
paragraph. The above-identified claims have been amended and, applicants respectfully submit, 
overcome the Examiner's objection under 35 U.S.C. §112, second paragraph. 

Claims 1 through 16 stand rejected under 35 U.S.C. § 102(b) as being anticipated by Rudt 
(U.S. Patent No. 5,717,456). Applicants respectfully traverse this rejection. 

Rudt is directed to image synchronization to identify and display image deviations from a 
plurality of camera positions. However, unlike applicants' claims 1 through 16, Rudt does not 
teach or suggest a "selection area" (10, 10') that corresponds to a number of sequential images of 
at least some images in a point of synchronization. Applicants' claimed selection area is useful 
in enabling an operator to select any image within the number of sequential images identified in 
the selection area (see applicants' specification, page 3, lines 8-18). 
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Furthermore, Rudt does not teach or suggest a selection area (10, 10') that represents a 
number of sequential images depending on "at least one of the speed of the paper web being 
monitored, and distances of at least some of the plurality of cameras." Instead, Rudt is based on 
the location of different deviation detectors 38 in combination with time detection of the 
deviation by each detector 38 (see col. 7, lines 43-47 emphasis added). Rudt mentions "machine 
speed" among other parameters which are not used for synchronization purposes (see col. 7, line 
49). Rudt's synchronization technique uses time and location data for the deviation detectors 38, 
which is in contrast to applicants' invention that includes no deviation detector. Unlike Rudt, 
applicants' deviations in sequential images is derived from image variation data. 

Accordingly, applicants respectfully submit that elements of applicants' claims 1 through 
18 are missing from Rudt and, therefore, Rudt does not anticipate applicants' invention. 

This application is believed to be in condition for allowance, which action is earnestly 
solicited. 

I hereby certify that this correspondence is being Respectfully submitted, 
deposited with the United States Postal Service with 
sufficient postage as First Class Mail in an envelope 
addressed to: Commissioner for Patents, P.O. Box 

1450, Alexandria, VA 22313-1450, on June 18,2003: /I 




Robert C. Faber 



Robert C. Farmer 7 
Registration No.: 24,322 

OSTROLENK, FABER, GERB & SOFFEN, LLP 
1 180 Avenue of the Americas 
New York, New York 10036-8403 
Telephone: (212) 382-0700 
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JUN 2 6 2003 

Technology Center 2600 

Method [for synchronising] For Synchronizing Image Data Obtained From 

Process Monitoring Cameras 

FIELD OF THE INVENTION 

The present invention relates generally to synchronizing image data, and. 
5 more particularly, selecting related images from a plurality of different camera 

positions. 

BACKGROUND OF THE INVENTION 

When an operator of several cameras films an event, for example, to analyze 
a paper web, and finds an interesting object, bv utilizing synchronization, he will be 

10 able to see the same area in the paper web as it passes other camera positions. This 

type of synchronization has long been a characteristic of the Applicant's operations. 
However, its use involves certain problems or deficiencies. Due to the high speed 
and stretching of the web, it is not possible for synchronization to be so accurate as to 
necessarily show the corresponding area in the web in the new position shown bv the 

15 synchronization. If there is. for example, an interruption at the dry end of the 

machine and the operator of the monitoring system searches for the same area in the 
web at the wet end of the machine, the operator cannot be absolutely certain whether 
the object is located in the area of the video recording displayed as a result of 
synchronization, in which case the operator is likely to discontinue the search. 

20 SUMMARY OF THE INVENTION 

The present invention is provided for improved synchronizing of image data 
obtained from process monitoring cameras . wherein f 
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The object of the invention is a method for synchronising image data obtained from 
process monitoring cameras, in which method] 

- different positions in the process are imaged using various cameras; 

- image data from the different camera positions is stored per camera into 
5 digital image processors; 

- images stored at the different camera positions are selected for display and 
analysis on the operator's computer [scree] screen ; and 

- from the image data obtained at the different camera positions are searched 
images depicting the same area in the web by using [synchronisation means.] 

10 synchronization means. 

[When the operator finds an interesting object among the images of a particular 
camera position, by utilising synchronisation he will be able to see the same area in 
the paper web when it passed other camera positions. This type of synchronisation 
has long been a characteristic of the Applicant's operations. However, its use 

15 involves certain problems or deficiencies. Due to the high speed and stretching of the 

web, it is not possible for the synchronisation to be so accurate as to necessarily show 
the corresponding area in the new position which the synchronisation produces. If 
there is. for example, an interruption at the dry end of the machine and the operator 
of the monitoring system searches for the same area in the web at the wet end of the 

20 machine, the operator cannot be absolutely certain whether the object is located in 

the area of the video recording displayed as a result of synchronisation, in which case 
the operator is likely to discontinue the search. 

The aim of the present invention is to provide an improved synchronisation method, 
so that the operator will know for certain that he will arrive automatically in the 
25 middle of the visualised area, inside which the desired same area of the web can be 

found. The idea is. therefore, to compel the operator to go through an area of 
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sequential images of a size that can be parametrised. In such a case, the 
corresponding area in the web in different camera positions will be found more 
reliably and easily. 

The characteristic features of the method relating to the invention are presented in the 
5 appended claims 1 and 2. The dependent claims disclose preferred embodiments of 

the invention.] BRIEF DESCRIPTION OF THE DRAWINGS 

An exemplary embodiment of the invention is described in the following with 
reference to the accompany drawings in which: 

Figure 1 shows the system used for implementing the [synchronisation] 
10 synchronization method relating to the invention as a flow chartfj; and 

Figure 2 illustrates the performance of [synchronisation of] synchronization 
on the basis of image data from different camera positions. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The aim of the present invention is to provide an improved synchronization 

15 method, so that the operator will know for certain that he will arrive automatically in 

the middle of the visualized area, inside which the desired same area of the web can 
be found. The idea is, therefore, to compel the operator to go through an area of 
sequential images of a size that can be parameterized. In such a case, the 
corresponding area in the web in different camera positions will be found more 

20 reliably and easily. 

The general structure and operation of the system are first described before 
[dislosing] disclosing the manner according to the invention for [visualising] 
visualizing the area of sequential images to be [synchronised] synchronized to the 
operator. 
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In the flow chart shown in Figure 1, the image source is a video camera 1 
which produces a continuous video image of the object being monitored. The image 
data is processed in a digital signal processor 2, or DSP processor. Signal processors 
are similar to ordinary microprocessors, but contain, among others, the use of 
5 floating-point number technology and address formats for easier addressing. 

Furthermore, the DSP is markedly different from the ordinary processor in terms of 
its architecture, having been [assigned] designed for duties involving large amounts 
of data, and where multiplication with integers and data transfers are statistically 
significant operations. DSP processors are capable of performing a plurality of 

10 different and simultaneous calculation routines associated with image analysis, the 
results of which can be applied automatically to monitoring changes in image data. 

The system comprises several video cameras 1 for imaging the various 
positions of the process being monitored. Each camera is provided with its own 
digital image processor 2 for storing digital image data per camera. The signal 

15 processors 2 are used for [analysing] analyzing each camera-specific image data item 
so as to provide image variation data based on the level of variation in a plurality of 
sequential images. From the signal processors 2 the said image data and image 
variation data are transmitted to an [analysing] analyzing computer 15 which has a 
display 11. 

20 The images stored at the different camera positions can be selected for 

analysis by means of selector icons 7. The image variation graph 8 corresponding to 
the image variation data of images preceding and following the image to be 
[analysed] analyzed is displayed at the bottom of the screen 1 1 . A floating arrow 
designated by reference numeral 9 indicates the point on the image variation graph 8 

25 at which the image 6 displayed is located. The floating arrow 9 can be used for 

selecting an image at any point on the graph 8 for display, [the] The image data 2d! - 
2d n stored from each camera position 1-n may encompass several hundred images. 
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Depending on the process, the image data in store at each time may have a duration 
ranging from a few seconds to several minutes, and the storage may function on the 
FIFO (first in first [our)] out) principle. 

Since each image variation graph 8 shown at the bottom of the screen 1 1 is 
5 prepared of image material from each respective camera position [respectively], the 
image variation graphs of the different camera positions can be [standardised] 
standardized so as to be comparable, and be compared with each other, whereby the 
image [vaiation] variation graph representing the highest-level variation and [th 
eimage] the image data of the camera position corresponding to it can be selected 

10 automatically for displaying on the [analysing] analyzing window of the screen [1] 
11. For the purpose of this automation, the system is provided with [standardising] 
standardizing means 3 for [standardising] standardizing the output levels of the 
image variation data of the different camera [posiitons] positions to be mutually 
comparable. A [co parison] comparison between the [standardised] standardized 

1 5 image variation levels of the different camera positions is performed by means of 

comparator means 4. Selector means 5 receive image data from the different camera 
positions and select, under the control of the comparator means 4 [the image], the 
image data 2d! - 2^ representing the highest-level variation and the corresponding 
image variation graph 8 to be displayed on the screen 1 1 . Image 6 is one of a 

20 multitude of images included in the image data. The graph 8 and the floating 

indicator 9 can be used for examining those very images 6 associated with the area of 
the highest-level image variation. The image 6 on the screen 1 1 may represent, for 
example, a hole formed in a paper web. 

The automated selection of the image 6, as described above, is obviously 

25 optional, meaning that the operator may, if he so desires, select image data 2d! - 2d,, 
from any camera position for analysis. However, it is often useful for the operator to 
know at the very beginning of analysis which camera position produced the 
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highest-level image variation, in which case the analysis can be started from this 
particular camera position. 

The operator's data processing means 15 comprise synchronization means 12, 
13, 14 by means of which images depicting the same area in the web can be sought 
5 automatically from the image data of different camera positions. When the 

synchronization option 12 is displayed on the screen 1 1, the synchronization unit 13 
controls the image data selection unit 5 in such a way that the selection of a camera 
position by means of the selector icons 7 automatically produces on the screen 1 1 the 
image 6 which corresponds to the same area in the paper web as the image 6 of the 

10 previous camera position. For this purpose the synchronization unit 13 requires 
certain parameters 14, which include at least web speed and the distances between 
the cameras 1. The synchronization unit 13 is also given a time of occurrence 2t at 
which an interesting object was observed in the image field of a camera position, the 
web area corresponding to which having to be analyzed from the different camera 

15 positions. 

Figure 2 shows a hole, for example in the size press, in an image produced at 
point of time 2t in the image data 2d,, of camera n. On the basis of the time of 
occurrence and other parameter data, the synchronization unit 13 is able to 
determine, by means of simple calculations, the images 2s, - 2s 3 in the image data 2d, 

20 - 2d 3 in which the same hole appears. The accuracy of synchronization cannot, 

however, be very high due to the high speed and stretching of the web, and thus in 
the invention is specified a marker 10, 10' of a certain width, which is visualized for 
the operator, within which the corresponding point in the web will be found with 
certainty. For the operator is thus visualized a section area 10 in the environment of 

25 the point of synchronization 9, 9' of each camera position, within which area there is 

a limited number of sequential images among which the corresponding point will be 
found with certainty. The said limited number is preferably a minimum number 
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determined by the parameters such as web speed and distance between the camera 
positions. This marker area 10 motivates the operator to search for the corresponding 
point in the different camera positions. The size of the selection area 10, that is, the 
number of images contained by it is, therefore, dependent on web speed and the 
distances between the cameras. 

Although the present invention has been described in relation to particular 
embodiments thereof, many other variations and modifications and other uses will 
become apparent to those skilled in the art. It is preferred, therefore, that the present 
invention be limited not by the specific disclosure herein, but only bv the appended 
claims. 



